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ABSTRACT 

We establish some uniform limit results in the setting of additive regression model estima- 
tion. Our results allow to give an asymptotic 100% confidence bands for these components. 
These results are stated in the framework of i.i.d random vectors when the marginal inte- 
gration estimation method is used. 
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; 1 Introduction 

^— > 

For d > 2, let (X, Y) be an M. d x M- valued random vector. The regression function of Y 
given X = x is defined, for any x 6 M. d , by 

m(x) = E(Y\X = x). (1) 

For < p < oo, the optimal L p rate of convergence of a nonparametric estimate of m 

-k 

is of order n 2k + d when m is assumed to be a fc-t i mes d ifferentiable function and for p = 



oo, the optimal rate is (n logn) 2fc + d (see, iStonei (119851 )). This rate of convergence which 
depends on the dimension a of the covariable X becomes worse as the dimensionality of the 
problem increases. In the literature, this phenomena is known under the name of "curse of 
dimensionality". To reduce the dimension impact upon the estimates, Stone (1985) proposed 
several sub-models of model ([I]). More particularly, he studied the nonparametric additive 
regression model in which the multivariate regression function is written as the sum of 



univariate functions, i.e, 



m(x) := m a(M (x) = fj, + J^m^Xj). (2) 



i=i 



To study the model (TSJ), several estimatio n met 



r ods ha ve been proposed, in the literature. We 



cite, the method based on B-spline (see, IStond (1l985l )). the method based on the backfitting 
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algorithm (see, lHastie and Tibshiranil ( 1986)1; hereafter, we make u se of the marginal inte- 
gration method, (see, iNeweyl (119941 ). iTjOstheim and Auestadl (1 19941 ) and Linton and Nielsen 
(1995)). Th e additive regression c ompo nents have motivated the work of many researchers, 
we refer to ICamlong-Viot et al\ (120001 ) for a survey o n the asympto t ic nor mality of the 



additive components under a mixing condition and to ISperlich et all (12 002) 



or nonpara- 

metric estimation and testing of integration in additive models. iDebbarhl (120041 ) established 



the law of iterated logarithm for additive regression model components under the indepen- 
dence assumption on the sample (Xj, Yi)i=i n - I n this paper, we establish some uniform 
limit results in probability i n an additive regression model. Similarly to results stated by 
Deheuvels and Masonl (120041 ) for functionals of a distribution based on kernel-type estima- 



tion, our results allow us to build asymptotic 100% confidence bands for the components we 
estimate. 



2 Main results 

First, introduce some notations and assumptions. We denote by / and fi the joint density 
of X and the marginal density of Xi, for I = 1, d, respectively. We consider the following 
assumptions upon m, f and fi,l = l,...,d. The functions / and fi are continuous with 
compact supports and there exist b, bi, B, and Bi such that 

(FA) < b < f(x) < B < oo and < k < f t (xi) < Bi < oo. 

(F.2) m is fc-times continuously differentiable. 

(F.3) / is /c'-times continuously differentiable, k' > kd. 

Throughout, (£ n )n>i, (h n ) n >i and (h^ n ) n >i, 1 < I < d, are sequences of positive constants 
satisfying the following conditions 

(if.l) hi n — > 0, and £ n , — > as n — > oo. 

(H.2) nh^ n — > +oo, nhi^ n / log(n) — > oo as n — >• oo. 

(F.3) nh hn hl%... h 2 d k ^/\ log h hn \ — »■ 0, ki + ... + k d = k, and h hn \og(n) / £ d n \ \ogh 1>n \ — ► 
as n — > oo. 

(HA) h n ~ n -2k/{2k+i) anc j n h l n h 2 n /\ log /ii )Tl | — > as n — >• oo. 

Let / = rii=i^ = nf=i[ a j5 c «] an d J = nf=i Jt = lIiLi[ a i5 c i] be two fixed pavements of 
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M. d such that a[ < dj < ci < c'^ 1 < i < d. Furthermore, we consider the following assump- 
tions upon the random variable Y . 



(M.l) yi{ X6 J} is bounded. 



Let (Xj,Yj)j =1 jn be a n-sample with the same distribution as (X, Y). Let L be a ker- 
nel on IR d , of order k' , bounded and with compact support. We define the kernel estimator 
/„ of the density / by 

«x)=4x>(^). 

i=i 

To estimate the multivariate regression function defined in ([1]), we will be used the tow 
following estimators, 



m n x 



and 



rn 



\ Y{ / "l r 1 /X; — -Xj,Z 



(3) 



(4) 



where, the kernel functions if and if, / = are bounded, continuous, and integrate 

to one. In addition, we assume that K\ satisfies the following conditions 



(K.l) K := fill Ki is of order k. 



(K.2) Ki{u) = for u <£ [-^, for some < A/ < oo. 



(if. 3) K = nli i s square integrable function in the linear span (the set of finite lin- 
ear combinations) of functions \I/ > satisfying the following property: the subgraph of 
{(s, u) : ^(s) > «}, can represented as a finite number of Boolean operations among sets of 
the form {(s,u) : p(s,u) > <f)(u)}, where p is a polynomial on M. d x R and (J) arbitrary real 
function. 

In particular this is satisfied by if (x) = 4>(p(x)), p being a p olyno mial and 4> a bounded re al 
function of bounded variation (see 



Nolan and Pollard 



(J1987I) and lQine and Guilloul (|2002|)). 
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As already mentioned, the marginal integration meth od will b e use d to estimate the ad- 
ditive components (see iLinton and Nielsen! (119951 ) and [Neweyj (119941 ) ) . Towards this aim, 
for all x = (xi,...,Xd) G M. d and every x_; = (xi,.., in, Xi + \, .., xa), I = l,...,d, set 
?( x ) = Yli=iQi( x i) an d <Z-/( x -0 — Y[j^iQj( x j)- Then, the l-th component rji of the addi- 
tive model is given by 

(5) 



(6) 
(7) 



7]i{xi) = I m(x)g_;(x_;)(ix_i - / m(z)q(z)dz, l = l,...,d, 
in such a way that the two following equalities hold, 

rji(xi) = mi(xi) - [ mi(z)qi(z)dz, 1 = 1, ...,d, 

m 



d „ 

x ) = y2vi( x i) + / m(z)q(z)dz. 



In view of (JSJ) and 0, r\i and rri[ are equal up to an additive constant. Therefore, r\i is an 
additive component too, fulfilling a different identifiability condition. Note also that r\\ = mi 
for the particular choice qi = fi, I = 1, d. However, fi is generally unknown, and rji ^ mi 
in practice. From ([3]) and (jSJ), a natural estimate of the /-th component rji is given by 

rfi(xi) = / m n (x)g_ ; (x_i)rfx_; - / rh n (z)q(z)dz, l = l,...,d. (8) 

From © and (jHJ), we derive an estimate rh add of the additive regression function, 



madd 



d „ 

x) = ^rfi( x i) + m n (z)q(z)dz. 



(9) 



In other respects, we impose the following assumptions on the known integration density 
functions q_\ and qi, I = 1, d, 

(Q.l) q^i is bounded and continuous, I = 1, d. 

(Q.2) qi has k continuous and bounded derivatives, with compact support Q C Ii, I = 1, ...,d. 

Let <f>(ui) be a continuous function on the interval I\ defined by 

H(u) 



<f>(ui) 



-g_i(u_i)du_i, 



where 



-i /(U_i|lti) 

H(u) = E(y 2 |x = u), u = («!, ..., Ud ) e R d . 
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Consider the following quantity 



(10) 



The following results describe the asymptotic behavior of the estimates 771 and rh a dd- From 
p 

now on, — > denote the convergence in probability. 

Theorem 1 Under the hypotheses (F.l) — (F.3), (H.l)-(HA), (K.1)-(K.Z), (Q.1)-(Q.2) 
and (M.l), we have, as n — > 00, 



sup ±{rj 1 (xi) - 771 (xi)} (7i. 



(11) 



2\ loghi >n \ 3:16/1 

Theorem [2] below is valid under the additional condition that for any all 1 < I < d, h^ n = 

Theorem 2 Under the hypotheses (F.l) - (F.3) , (H.l)-(HA), (K.1)-(K.3), (Q.1)-(Q.2) 
and (M.l), we /lave, as n — > 00, 

d 



nh hn 



2 1 log /i 



— r sup ±{ m a dd(x) - m(x) I — > V" 07. 
l,n xe/ L J , 



3 Application 



3.1 Confidence bands 



Let o"i jn (xi) be the estimator of o-\{x\), with ai{x\) = y/<j)(xi)/ fi(xi). We will consider the 
data-dependent function L n (xi), defined by, 



L n (xi) 



where 



21og(W 
nh x .n 



x 0-1 „(Xi 



1/2 



1/2 



n«^i 4„^( 



g_i(x_i) dx_i. 



We obtain asymptotic simultaneous confidence bands for 771 (xi) in the following sense. For 
each < e < 1, we have 

p{t7i(zi) G [^i(xi) - (1 + e)L n (xi), ft (a*) + (1 + e)Ai(zi)] , V^G/i} — ► 1, 



and 



^{riiM e r}i(xi) - (1 -e)L n (xi), ?7i(a;i) + (l-e)L n (xi)], VxiG/i} — ► 0. 

We say then that the intervals 

Ai,i(zi), ^ ni i(xi) = 771 (xi) - L„(xi), 77i(xi) + L n (xi} 

provide asymptotic simultaneous confidence bands (at an asymptotic confidence level of 100 
%) for T)i(xi) over X\ Eh- We deduce the asymptotic confidence bands for m add , over x£/, 

cZ d 



rh n (x)q(x)dx. 



A,(x), £„(x) = |f w + y^ An^gj), //n + ^ B n>l (xi) , where /x n = 

z=i z=i 

Following a general statistical practice, for finite values of the sample size n, we recommend 
the use of the asymptotic 100 % confidence bands. Our results do not provide confidence 
regions in the usual sense, since they are not based on a specified level 1 — a. Instead, they 
hold with probability tending to 1 as n — > 00. 



4 Proofs 



Let Q be a class of pointwise measurable functions satisfying conditions (C) in the Appendix. 
We denote by a„(.) the multivariate empirical processus based upon (X 1; Y ± ), (X 2 , Y 2 ), ... and 
indexed by the class of functions Q. More precisely, a n is defined for g e Q by, 



1 ™ 

a ^) = -frH (^( X - F *) " ^( X » Yi)) 



For any real valued function defined on a set 5, we use the notation \ \4>\\b = sup xeB I0( rc ) I := 
|. Recalling that I\ = [ai, Ci], let < 77 < 1 be a fixed number and set, for n > 1, 

"Ci — Oi" 



xi,j = ai + jJ7/ii, n , < j < /„ := 



77/1 



l,n 



where [u] denotes the integer part of u. For Xj = (Xj il? ...,1^), 1 < i < n, set 

r x 1 - X L 



^(x,,^) = W^i(V^)' 



where, 



G(Xi) 



.(n^H?)^ 



(12) 



(13) 



(14) 
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For n > 1 and any < j < l n , let Q n = {gn 1 ' 3 '■ < j < l n }. Obviously, for each < j < l n 
and any x\ G Ji, we have 

IISn 1,J ll + llfin 1 !! — K ? where k is a positive constant. 

In the first time, we assume that the density / of X is known. Let m n be the estimator of 
the regression function when / is known, 

1 - Y- / d 1 



m r . 



n /(Xi) VAi hi <n " 1 V 
Using the estimator ([8]) of the additive regression model components, we obtain 



nh 1<n / (m„(x) - E(m n (x)) )g_ 1 (x_ 1 )rfx_i 
-nh lin (m n (x) - E(m n (-x)))q(x)dx, 



Vnotnig* 1 ) - / y/notnig^q^x^dxi, 



where, 



(15) 



y/natnig* 1 ) = nh 1>n / m n (x) - £(m n (x)) g_i(x_ 1 )rfx_ 1 . 
The proof of Theorem [1] is based on a number of additional lemmas. 

Lemma 1 Assume that the conditions (F.l) - (F.3), (H.l) - (H.3), (K.l) - (K.3), (Q.l) - 
(Q.2) and (M.l), are satisfied. Then, we have, as n — > oo 



y/2h hn \\ogh 



l,n 



Following iDeheuvels and Masonl (12004J ) and lEinmahl and Masonl (120001 ). the proof of Lemma 
[I] is split up into two part. First, we establish the upper bound, afterward, we state the lower 
bound. 



4.1 Proof of Lemma [T] 
4.1.1 Upper bound part 

The main tools used in the proof are the discretization and the properties of empirical pro- 
cess oscillations. 
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Part 1. We examine the behavior of our process on an appropriately chosen grid, 
(xi,j)i<j<i„ of I\. Assume that the assumptions of Lemma [T] hold. It follows from ( TT3I) 
that 

2\ 



< £?(£(^ 2 |X i )G 2 (X 4 )X?( 



2 ( 



< £?(g(X < )G 2 (X i )^( XlJ '~^ 1 )). (16) 

But, making use of classical changes of variables and Taylor expansion, we get under (K.l) 
with h_i = (/i2,nj ■••) hd, n ) T and < < 1, 



| J (Ki(vi)qi(vihi in + mUdx-x 



\ ( TT^ i (t; i ))( ? _ 1 (v_ih_i + U-i)(iv_i 



= g_ 1 (u_i)+o(l). 
Therefore, it hold that, 



( t,n(i' f O"W) t f'-.("-i + "W' < 17 > 



Moreover, in view of the (JHj), we have 



E[H(Ki)G (Ki)K{ 



hi, n 



y R d /(u) V 7 R d-i -M- /ii, n V /i /jn / /V hi >n / 



Combining ( TIB"]) . ( fTTI) and ( |T8l) . we obtain 



Var^(X t ,Z t ,6 t )^ < a\h x>n + o(h 1>n ) . (19) 



-2 ( r 1 2 (l+p) 2 / iljn | 


loj 


, r ^l,n| 




2a 2 1 h hn + ^a 1 ^2h hn \ 


log hi >n \ 



Applying Bernstein's inequality to the sequence of random variables, 

Z r = g^(X r ,Y r ) - E(g^{X r ,Y r )), r = 1, ...,n, 
we obtain, for n large enough, that, 

P{ max \a n {g^)\ > a x {\ + p)^2h l)n \\ogh l)n \} 

< 2(/ + l)exp 

< 2(/ + !)/»£*. (20) 



Part 2. Under assumption (K.3), the class of functions 

{^(— ) :teR d ,a6R d \{0}} 
is a bounded VC class of measurable functions. Now, consider the class 

T= [byK^-—-^ :t eR d ,aeR d \{0},\b\ < d}, 

where D > is the bound of the function t/G(x). Arguing exactly as in pages 254 and 255 of 
Deheuvels and Mason (2004), one can show that T fulfills C. An easy argument now shows 
that 

G' = ^byK^— ) : M' e R d ,a,a' e R\ {0}, \b\ < D,\b'\ < £>} 

fulfills conditions C. As over G function we can take 

G(u,v) = 2(7^11^1100. 

Since C Q' . We study the behavior of our process between the grid points xij, xij+i, 
with 1 < j < l n . Toward this aim, consider for < j < l n , the class of functions 

j 

There exists an absolute constant B, such that for any e > 0, one can find a r\ t such that 
whenever f fT2l) holds, with < r\ < r) e , we have, 

P{ll^ 1/2 an|| g ; > ByJenh 1>n \logh 1>n \} = o(l). (21) 
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Indeed, we see that, uniformly over g e Q n • C Q n , \\g\ \ < k. Moreover, by similar arguments 
as those used in the proof of (TTBl . we have, 



al, = sup Var(#(X, Y)) < Ah x n a\. (22) 

Therefore by Fact 1 (see the Appendix), for all t > we have for suitable finite constants 
A U A 2 > 0, 



n 

p{ I W 2 a n \ y n >a^e\\J2 ^(Xi, y,) i \ g , n + t) } 

1=1 

£ 2 M-^) +ex K-^r)} 

^{-(-5&) + -»(-v)}- « 23 » 



Next, by using (|T2l . in combination with Fact 2 (see the Appendix), we obtain that 



^ll^e^x^)!!^ <^'yWvi°g(i/V)- ( 24 ) 

i=l 

Where A' is an absolute constant. Thus, using (I24|) . we get from (123]) that 

P{lh 1/2 ttn|| g ; > 2A 1 Ayi/n/ii, n |log/ii, n |} (25) 

. / A 2 (AiA') 2 i/|logfoi. w | ^ / A 2 (A l A') v /ynh hn \logh hn \ ^ 

~ ZeW \ o\ M ) 

= o(l). (26) 



Taking B = 2A X A' \fve in ([25]), we complete the proof of (JZEJ 
For 1 < j < l n , Q' n j C £? n , we see that 

< "'" — (27) 



max <j<; |K /2 an|| g ' 





\n 1/2 a n \ 


k 


y/2nh ltn \ 


lo 


g^l,n| 



^n/ii^l log/ii, n | 

Using the statement fl2Tj) and the inequality (j2"7|) with A = ^75, we obtain 

r maxi<j<j„ \\n l / 2 a n \\ Ql . 

H yi: 1 1 =^ > = o(l), (2* 

< ^2n/ii,„|log/ii in | > 
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Conclusion : By combining (j!2p and fl28|) . we conclude that there exists an absolute con- 
stant A > 0, such that 

< — ; = ==- > (1 + p + A^/e)ai \ < P< max > (1 + pjcri ^ 



P 



i 



+P<^ max n ^ = > A^ea 1 \. 

U<i<J» y/2nh 1>n \]oghi tn \ > 



Since for any e > 0, we can choose p > and e > small enough so that p + A^ft < e. We 
obtain the upper bound result in the case where / is known, 

P (g^M£)l >(1 + e) i =o(1) 

a/2^ 1; „| log/i 1)Tl | J 

4.1.2 Lower bound part 

In order to prove lower bound result, we gather hereafter some technical results (see, Einmahl 

and Mason (2000)). Let Z±, Z 2 , be a sequence of i.i.d random vectors taking values in 

M. d . For each n > 1, consider the empirical distribution function defined by, 

n 

G n (s) =^ 1 ^I {Zi < s} , seR d+1 , 
i=i 

where as usual z < s means that each component of z is less than or equal to the corre- 
sponding component of s. For any measurable real valued function g(.) defined on 
set 

Gn(g) = [ 9(s) dG n (s), fi(g) = E(g(Z)) and a(g) = y/Var(g(Z)). 

Let {a n : n > 1} denote a sequence of positive constants converging to zero and satisfying 
the condition | log(a n )|/loglog(n) — > oo. For some sequence of integer number k n , consider 
a sequence of sets of real valued measurable functions on M. d+1 , Q n = {g!j. , % = l,...,k n }, 
defined by the following conditions: 

(a) F^ n) (Z)^0, ft W(z)^0)=0, ^l<i^j<k na ndY,t 1 P{gt\z)^0)<l/2. 
Furthermore, assume that for some < r < oo, 

(b) a n k n — > r as n — > oo. 

For some — oo < \i\ < p 2 < oo and < G\ < a 2 < oo, uniformly in i — 1, k n , we have for 
n large enough, 

(c) a n pi < p(gl n) ) < a n p 2 and y /a^a 1 < a(g^ n) ) < y/a^a 2 . 
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For some < M\ < oo, uniformly in i = 1, k n , we have for n large enough, 
(d) Ik^il^ML 

The following lemma due to Einmahl and Mason (2000) is the main tool to prove our result. 
We will work only in the "+" case, the arguments for the "-" case can be obtained similarly. 

Lemma 2 Under assumptions (a) — (d) ; for each < e < 1, we have 

„f ..■"*{G.(^)-rtft W )K, .1 ., 
I !<(<*. ff ( ft <"»)^2[toiK)| > 

Proof: See Proposition 2 of Einmahl and Mason (2000). 

In order to apply the result of Lemma [U we need to check the validity of the conditions 
(a) — (d) in our setting. For any e > 0, select a sub-interval J% = [a' l7 c'j] of Jj = [a 1; ci], 
such that 



inf 



(j)(Ui) 



k(\ V2 ; >(7i(l-e/2) 



and 

P{Xi G Ji} < 1/2. 
Consider the following points in the interval J\ 

X U = a 'i + 2 J h i,n, fo r J = 1, [{b'x ~ a\)/2h hn } - 1 := k n . 

Then, it is easy to see that the condition (b) is satisfied with a n = hi <n , i.e. 

lim h hn k n « [(6i - a 1 )/2}. 

n— >oo 

For each xij, 1 < j < fc„, define the functions 

^»)(x,y)=yG(x)lf 1 (^l^), 

it follows from (F.l), that 



^ n) ||<M||G||x||K||:=M : 



i- 



so the condition (d) is verified. 
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Now, we verify the validity of the condition (a). To this end, recall that K\ is compactly 
supported, therefore, 



gl n) (X,Y) ? 
and then 



hi* 



1 

£ 2' 



\x uj -X iA \ - \ x , J - Xu + XlJ -X, i \>2h l „-'^f. 
Hence , for 1 < i ^ j < k n , 

P{ g^(X, Y) ± and gf\^ Y) ± o} = 0. 
To check the validity of the condition (c), recall the inequality f|T6|) and observe that, for 

Var(^(X,F)) = £?(^G a (X 4 )A?(^^)) - E^fr)^*^ 1 " N " 

> h.JlKl) inf |^ + o(V) 

> a 2 (l - e/2)h 1>n . 

Now, we can use the result of Lemma [2J which yields, 



< P { ^(g.ton-^ w )) ;(1 5) 3/ ViC i 

- li<i<*. v /2fe 1 ,„|logfe 1 ,„| ' ' 

For a n = /i ln , we get from last inequality 

By setting (1 — e) 3 / 2 = 1 — |-, and using the inequality, 

SU PxigJl y^an(^l) . ^ 1/2 (Gn(^)-^ (W) )) 
. Ml MX 5 

a/ 2n/ii in | log /i 1)n | a/ 2/n, n | log h 1>n | 
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we obtain 

p { r^dio"f\i <(i -H- (i) - 

^ A/2/ii, n , n| log(/j,i jn ) | 2 > 

Combining the results of Part 1 and Part 2, it follows that, 



y/2hi <n \ log Jh, 



o P (l). 



Similarly one may show that 



y/2h^\ \ogh h 
This completes the proof of Lemma [Tin 



0P (1). 



4.2 Proof of Theorem [T] 

Let us use the decomposition, 

±07i0i) - ^i(^i)} = ±{m(^i) - ViM} ± Oh(xi) - ^(^(xi))} ± {E(r)i (xi)) - ?7i(zi)} 
= T 1 (x 1 )+T 1 (x 2 )+T 3 (a;3). 



First, consider the term Ti(xi). It hold that, 



m n x = m„, x 



+^i>(n^ 



1 ^/Xj-^AN/CXi)-/^) 



hl,n I) f(Xi)f n {Xi) 



It follows that, 



m„(x) - m n (x) 



?? 



i=l i=l 



X 



SU Pl<i<n 











(29) 



Using, for example, the following result due to lAngo-Nze and Riosl (120001 ) 



sup I /n(*0 ~ /(*) |= {\l °n £ d 1 a - s -' 



(30) 



we obtain under the assumptions (M.l) and — (if.2), for n large enough, 

mjx) |=OU; —I a.s. 



sup | m n (xj 



(31) 



14 



Observe that, 



< 



m„(x) - m„(x 



n \ 



g_i(x)dx_! + 



m„(x) - m„(x 



n V 



g(x)<ix 



sup 


m n (x) - m n (x) 


g_i(x_i)rfx_i + 


/ sup 


m n (x) 


- m n (x) 


1 xei" 






jRd xei" 







< Gk 



log(n) 



a.s., 



where C is a positive constant. Therefore, we have 



I //J ('■'•.! ) - * 1= 0{ I 



116/1 



(32) 



Combining f[3"2"j) and the assumption (H.3), we obtain, 

sup Ti(xi) = o(l) a.s. 



nhi, n 



2|log/ii, n | xieh 
Next, turning our attention to T%(xi). It hold that 



(33) 



m(x) - E(m n (x)) 



m(x) — E 



/(X,)Lii 



d 



mix 



Xl ~ Ui 



hi 



du 



The change of variables and the Taylor expansion to order k, gives, with < 9 < 1 and 

h = (hi n, h dyn ) T 



m(x) - E(m n (x.)) 



m x — 



< 



< — 



/ m(-vh0 + x)(n^K))dv 

^ d v f=T y 

d 



m x — m 



i=l 



< 



1 



fei+...+fe d =fc 

d k m 11 



d k m 



dv?...dv h d 



vhB + x)\(Y[Ki(vij)dv 



i=i 
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It follows that, 



sup T 3 (xi) < 2 sup m(x) — E(fh n (x)) 
xieh xe/ 

d k m 



2 

< — 
- k\ 



dv^...dv k d d 



£ h t- h t( f «N.#K(v)dv 



A,-i+...+fc d =fc 



By combining the assumption (H.3) and the statement (JMj) . we obtain, 



n/ii , 



sup T 3 (xi) = o(l). 



2|l0g/il )n | x^/! 

Finally we evaluate the term T 2 (xi). From (1151) . we observe that, 



nhxirj^xi) - Eff^xx))} = y/na n (g^) - / y/na^g^q^x^dxx 



then 



nhi n m . . ± a„( # 



2| log/i 



l,n 



A/2/ii in | log h hn \ 



v/2/ii in | log h hn 



We will use in this proof ICamlong-Viot et all (120001 ) notations 



dx(xi) 



n 

— Y 



1,71 /l(-^l) ^ ^1,71 



^1 — -i^i,l 



/ g-i(x_i) 



Using the Cauchy-Schwartz inequality, we obtain, 



q^x^dxi 



\/2hi, n \ log/ii, n 

{m n (x) - £J(m n (x))}g(x)dx 



2| log/i 



1,71 



< 



2 1 log/ii, r 
2 1 log /i 



{di(xi) - (xi) ) }gi (aci ) daci 



1,71 



{ai(xi) — E{a 1 {xi))} 2 dxi 



1/2 



X 



q\{x\)dx\ 



1/2 
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By ICamlong-Viot et al\ (1200(1 ) we have, for all x\ & Cx, 

Vax(ai(xi)) = ^(di(xi) - E(a l (x l ))^ = £>(V 2fe/(2/c+1) ) . 



then 



Var(di(xi))(ixi 



J e(&i(xi) — E{ai{x\)) j dx\ 
e( I (&i(xi) — E(&x(xx))\ dxx 

^ n -2k/(2k+i)y (38) 



From ([38]), it follow that, 

_(xx) - E{ax{xx))) 2 dxx = o(n~ 2k/{2k+l) ^ a.s. (39) 
By combining (!37|) . (1591 and the assumption (HA), we arrive at 



ail 

Ci 1 



n/n,„ , su P;cieJl ±a n (^) , a n (^ 

sup i 2 (^i) = , r =F / , = - qx(xx)dxx 



2|log/ii, n | xie/i " y/2hx, n \ log fri^J Jm v^vJ log/ii >n 

sup xi6/l ± a n (»n 



A/2/ii in | log h lin \ 



o(l) a.s. (40) 



Finally, note that (1331 . (135|) . (j40l and Lemma CD are sufficient to finish the proof of Theorem 

m 

4.3 Proof of Theorem H 

Observe that, 

on^/r m SU P ±{"iadd(x) - m a(M (x)} - V] a h 
2 1 log(/ii, n )| xe / ~ 

= \\ o\ l sup ± {^( x ') ~ ^( g 0} ~ a i) ( 41 ) 

^ L y 2\ loghx >n \ x t ei t > 

+ \ ^rrrf w I {^( x ) -m(x)}?(x)dx. 

V 2 1 l0g(/ll,n)| JR" 
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By proceeding exactly as we did along the proof of (|35|) and (|37|) . we arrive at, under the 
assumption (H.3) and (HA), 



nh hn 



{m n (x) — m(x)}g(x)<ix = o(l) a.s.. (42) 



2|l0g(/ll, n )| 

By combining Theorem [T] and the statement (l4"2"j) . we conclude the result of Theorem [21 □ 



5 Appendix 



Here we gather toge t her s ome basic Facts, that we need 



Einmahl and Mason 



fhoool ) 



and 



Einmahl and Mason! (120051 ) 



or the proofs. See, for instance 



Let Q be a pointwise measurable class of functions satisfying the conditions (C), whenever 
there exists a all x G S, 



and for some < z/, C < oo, 



with 



G(X) > sup 



N{e, G) < C Q e-", < e < 1, 



iV(e, 0) = supiV( ev /Q(G 2 ),£,d Q ), 
Q 

where the supremum is taken over all probability measures Q on (H, A) for which < 
Q(G 2 ) < oo and c?q is the L 2 (Q)-metric. As usual N(e, Q, d) is the minimal number of balls 
{g : d(g, h) < e} of c?-radius e needed to cover Q. 



Fact 1. Let ei,....,e n be a sequence of a random yariables indepen dent of the random 
vectors X\, ....,X n . The following inequality is due to iTalagrandl (jl994j ). 



Let < M < oo be a constant, such that 

1 < M, for all g 6 Q. 
Then for all t > 0, we have suitable finite constants A\,A2 > 0, such that 

P{ll^ 1/2 "n||g > A 1 ^||^e^(X i )|| g + ^} < 2[exp + exp ( - 

i=l " nCr G 



M 



(43) 



where a 2 g = sup g€g Var(g(X)). 



Fact 2. (jEinmahl and Masonl (120001 )) Let Q be a pointwise measurable class of bounded 
functions such that for some constants u, C>l,0<a<j3 and let G denote a function 
fulfilling the above assumptions. Assume in addition that the following four conditions hold 



A.l £(G 2 (X)) < (3 2 . 

A.2 N(e,g) < Ce~ v , < e < 1. 

A.3 sup geg E[g 2 (X)] <a 2 . 

A.4 swp ge g\\g\\<\J ulog ™* 0/er)) . 

We have for a universal constant A% > 0, 

n 
i=l 

Fact 3. (Bernstein's inequality) . Let Zi,....,Z n be independent random variables with 
mean and identical variance < a 2 := Var(Z r ) < oo, r = 1, ....,n. Assume further that 
for some M > 0, |Z r | < M,r = 1, ....,n. Then for all t > 

P(Zl + ... + z. > tM < exp ( - 2g2 + 2/ 3 Mn _ 1/2i ). 



Fact 4. Let rji, ...,rj n be independent mean zero random variables with s 2 = J^™ =1 -Ef? 2 > 
and -P{|^i| < di} = 1, where < dj f, 1 < i < n. if lim^oo d n x n /s n = 0, where x n > xq > 0, 
then for every 7 G (0, 1), there is a C 7 G (0, 1/2), such that for all large n 

n 

P{ J> > (1 - 7 ) 2 s„x„} > C 7 exp ( - x 2 (1 - 7 )(1 - 7 2 )/2) . 

i=l 
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